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T&E  Need 


•  Network  data  recorder  that  provides 
instantaneous  access  to  recorded  flight  data 
without  interrupting  ongoing  recording 

•  Parametric-level  data  retrieval  for  backfill  of 
data  dropouts  and  ad  hoc  requests 

•  Need  for  spectrally  efficient  retransmission 


S&T  Challenge 


'^A'D  TtC.' 


*  Recording  data  at  high  rates  while  at  the  same  time 
allowing  for  concurrent,  rapid  and  selective  data 
retrieval 

*  Developing  approaches  to  data  indexing,  storage, 
and  retrieval  that  optimize  overall  system 
performance 

*  Developing  ways  to  retrieve  data  based  on  complex 
criteria,  including  values  of  the  stored  data  itself  and 
derived  values  such  as  minimum,  maximum,  average 
within  a  time  interval 

*  Parallelizing  storage  and  retrieval  mechanisms  to 
enhance  performance 


Project  Description 


'^A'D  TtC.' 


hi  21 0_S2MSL015 


TENA 


The  Enhanced  Query  Data  Recorder  (EQDR)  will 
improve  test  efficiency  and  safety  of  flight  during 
data  dropouts,  non-nominal  modes  of  operation, 
and  inter-maneuver  periods 


Project  Description 


'^A'D  TtC.' 


•  Data  dropouts 

-  Instantaneous  retrieval  and  retransmission  of  lost 
test  data  or  for  backfill  to  improve  completeness  of 
control-room  data  for  quick-look  data  analysis 

•  Non-nominal  modes  of  operation 

-  Efficiently  retrieve  recorded  data  not  previously 
sent  to  ground  to  better  understand  “trends”  of 
non-nominal  behavior  observed  during  the  test 

•  Inter-maneuver  periods 

-  Retrieval  of  data  for  quick-look  analysis  to  ensure 
test  objectives  met  and  data  gathered  before 
moving  on  to  next  test  point 


S&T  Background  (slide  1  of  2) 


'^A'D  TtC.' 


•  Network  Data  Recorder  must: 

-  Record  and  retrieve  data  concurrently 

-  Record  at  high  enough  rate  to  capture  all  data 
onboard  the  test  article 

-  For  spectrum  efficiency,  retrieve  individual 
measurands  quickly,  with  specificity  and 
selectivity,  as  retransmitted  data  competes  with 
real-time  telemetry  stream  for  limited  bandwidth 


S&T  Background  (slide  2  of  2) 


•  Existing  Chapter  10  recorders  store  data 
by  time  interval  and  channel  only 

•  Implications 

-  Retrieval  also  limited  to  time  and  channel 

-  No  other  selection  mechanism 

-  No  filtering  based  on  values  of  measurands 
themselves 

•  Today’s  current  approach  does  not  meet 
needs  of  future  network  data  recorder 


Project  Scope 


Phase 

Brief  Description 

End 

TRL 

1 

•  Determine  optimal  approach  for  data  storage  and  retrieval 

•  Develop  underlying  EQDR  technology  components 

•  Demonstrate  effectiveness  and  flexibility  of  EQDR  components  in 
lab-based  prototype  (e.g.  desktop  environment) 

4 

2 

•  Port  EQDR  components  to  embedded  system  hardware  more 
representative  of  aeronautical  test  environment 

•  Optimize  software  performance 

•  Increase  multi-threading/parallelism  in  execution 

•  Characterize  performance  of  system  on  embedded  hardware 

5 

3 

•  Port  EQDR  technology  to  flight-capable  hardware 

•  Flight  demonstration 

6 

Performance  Testing  Setup 


*  Test  Configuration 

-  Intel  i7  610  @  2.53  GHz,  4  Threads 
-8  GB  RAM 

-  Windows  7  Professional  SP1  64  bits 

-  Java  7.0.3  64  bits  Photo  taken  by  SAIC 


'-'U'dteC 


•  Generated  Load 

-  Each  Data  Source  has  2000  Data  Items,  average 
size  20  bits,  500  Hertz  ->  20  Mbits/sec 

-  We  simulate  12  Data  Sources  ->  240  Mbits/sec 

-  Maximum  TmNSMessage  size  80  Kbits 

-  20  TmNSPackages  per  Data  Source 

-  100  Data  Items  per  TmNSPackage 
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Performance  260  Mbits/sec 
Recording  Rate  (Ta rg et ) 


id  cn  m  m 

ro  m  co  rN  co  oo  <n 

t-H  iH  fN  ^ 


msec  Latency 


Percentile 

msec 

90% 

178.3 

95% 

187.3 

99.9% 

281.7 

CPU  Load 

System  Total  avg. 

27.8% 

EQDR  Recorder  avg. 

17.7% 

MySQL  avg. 

3.9% 

EQDR  Total  avg. 

21.6% 
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Performance  at  480  Mbits/sec 

Maximum) 


M 


900,000 
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56  84  126  189  283  425  638  956 

msec  Latency 


Percentile 

msec 

90% 

251.6 

95% 

272.9 

99.9% 

630.7 

CPU  Load 

System  Total  avg. 

50.1% 

EQDR  Recorder  avg. 

35.6% 

MySQL  avg. 

7.0% 

EQDR  Total  avg. 

59.0% 

12 


Performance  at  600  Mbits/sec 
Recording  Rate  (Peak) 


msec  Latency 


Percentile 

msec 

90% 

560.4 

95% 

615.9 

99.9% 

2,893 

CPU  Load 

System  Total  avg. 

68.5% 

EQDR  Recorder  avg. 

49.3% 

MySQL  avg. 

9.7% 

EQDR  Total  avg. 

59.0% 

Retransmission  Performance 


250  Kbits/sec 

Retransmission 

5  Mbits/sec 

Retransmission 

20  Mbits/sec 

Retransmission 

System  Total  avg.  CPU  Load 

26.6% 

27.4% 

28.2% 

EQDR  Recorder  avg.  CPU  Load 

16.2% 

17.6% 

18.0% 

MySQL  avg.  CPU  Load 

3.9% 

3.9% 

3.9% 

EQDR  Total  avg.  CPU  Load 

20.1% 

21.5% 

21.9% 

Percentile 

msec 

msec 

msec 

90% 

176.9 

177.3 

179.6 

95% 

185.9 

186.6 

187.0 

99.9% 

344.0 

283.2 

283.1 

Concurrent  recording  (250  Mbits/sec)  and  retransmission 
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Summary 


•  The  Enhanced  Query  Data  Recorder  (EQDR)  will 
improve  test  efficiency  and  safety  of  flight  during 
data  dropouts,  non-nominal  modes  of  operation, 
and  inter-maneuver  periods 

•  Spectrum  efficiency  necessitates  retrieval  and 
retransmission  of  individual  parameters 

•  EQDR  enables  data  retrieval  based  on  complex 
criteria,  including  values  of  stored  data  itself  and 
derived  values  and  statistical  data 

•  Performance  on  Intel  i7  610:  480  Mbits/sec 
recording  with  60  Mbits/sec  concurrent 
retransmission 
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Disclaimer 


Any  opinions,  findings  and  conclusions  or 
recommendations  expressed  in  this  material  are 
those  of  the  author(s)  and  do  not  necessarily 
reflect  the  views  of  the  Test  Resource 
Management  Center  (TRMC)  and 
Evaluation/Science  &Technology  (T&E/S&T) 
Program  and/or  the  U.S.  Army  Program  Executive 
Office  for  Simulation,  Training,  &  Instrumentation 
(PEO  STRI). 
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